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Abstract 

In this paper, we consider a parallel relay network where two relays cooperatively help a source 
transmit to a destination. We assume the source and the destination nodes are equipped with multi- 
ple antennas. Three basic schemes and their achievable rates are studied: Decode-and-Forward (DF), 
Amplify-and-Forward (AF), and Compress-and-Forward (CF). For the DF scheme, the source transmits 
two private signals, one for each relay, where dirty paper coding (DPC) is used between the two 
private streams, and a common signal for both relays. The relays make efficient use of the common 
information to introduce a proper amount of correlation in the transmission to the destination. We show 
that the DF scheme achieves the capacity under certain conditions. We also show that the CF scheme 
is asymptotically optimal in the high relay power limit, regardless of channel ranks. It turns out that 
the AF scheme also achieves the asymptotic optimality but only when the relays-to-destination channel 
is full rank. The relative advantages of the three schemes are discussed with numerical results. 

Index Terms 

Gaussian parallel relay network, diamond channel, cooperative relaying, common information. 

I. Introduction 

Over the recent years, relaying has been considered as a promising technique that can increase 
throughput and reliability and enhance the coverage of wireless networks. There have been a 
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number of research results showing different aspects of relay channels. Cover and El Gamal [3] 
derived the capacity of a class of relay channels with a single relay that helps transmission from 
a source to a destination. Kramer et al. [4] generalized the results in various ways. Laneman et 
al. [5] considered cooperative diversity aspects of relay channels. In [23], the authors consider 
the multiplexing aspects of cooperative communications in multi-antenna relay networks. In [6], 
[7], multi-antenna relay channels are considered. The use of relays in broadcast scenarios is 
considered in [4], [8]. 

In this paper, we study the capacity of a vector Gaussian parallel relay network where two 
parallel relays help transmission from a source node to a destination node. The network model 
is first studied by Schein et al. [1], and a set of capacity theorems are derived for the discrete 
memoryless channel and the scalar Gaussian channel. The authors of [2] considered a similar 
model but with half -duplex constraint, i.e., relays do not transmit and receive at the same time. 
Recently, the authors of [22] showed their new achievable rate for general scalar Gaussian relay 
networks is within a constant number of bits from the cut- set upper bound on the capacity. A 
new achievable rate for the original Schein's network is derived using a Combined Amplify- 
and-Decode Forward (CADF) scheme in [24]. Our network model is different from the earlier 
ones in that both the broadcast channel (BC) part and the multiple access channel (MAC) part 
are vector Gaussian channels as the source and the destination nodes are equipped with multiple 
antennas. As the vector BC is not degraded in general and a simple superposition coding will 
not suffice. In the vector MAC, correlation between relay signals are not always beneficial, 
rather, the right amount of correlation may result in a better performance as will be seen in a 
later section. Throughout the paper, upper bounds and achievable rates by different cooperative 
transmission strategies: DF, AF and CF are derived. 

For the DF scheme, the vector Gaussian parallel relay network can be seen as a cascade of 
multiple-input single-output (MISO) BC and single-input multiple-output (SIMO) MAC chan- 
nels. We first extend some earlier results for the discrete memoryless and scalar MACs with 
common information to the vector Gaussian case, and investigate the characteristics of the 
three-dimensional achievable rate region. We use a known transmission scheme of [10] for 
the BC part. Using the BC-MAC schemes, we show that DF achieves the capacity of the vector 
Gaussian parallel relay network under certain conditions. In addition, we address the importance 
of common information signaling and correlation control. 
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We also extend some earlier results for AF and CF to the vector Gaussian case. We show 
when DF is strictly suboptimal and when AF and CF can outperform DF by comparing the 
achievable rates and the upper bound. We show that AF is asymptotically optimal in the high 
relay power limit if the channel rank of the MAC part is full. In addition, we also show that the 
CF scheme achieves the asymptotic capacity, regardless of the channel ranks. 

The rest of the paper is organized as follows. In Section 11, we introduce the system model. 
We derive a capacity upper bound for the vector Gaussian parallel relay network in Section III. 
Next, we derive achievable rates by the DF, AF and CF schemes in Sections IV, V and VI, 
respectively. Numerical results and comparison of different schemes are given in Section VII. 
Conclusions and final remarks are given in Section VIE. 

II. System Model 

The vector Gaussian parallel relay network consists of four nodes: a source, a destination, and 
two relays. We assume no direct link from the source to the destination. The relays are assumed 
to be full duplex, i.e., they transmit and receive at the same time. The received signals at the 
relays and at the destination are given by 

Vrl = glXs + n^l, 
yr2 = g2X5 + nr2, 

where 

• Xs e C^^^,Xri, Xr2 G C are the transmitted signals from the source and from relays 1 and 
2, respectively. Input covariance matrix and power constraint at the source node are given 
by Qs — Efx^xJ] and tr (Q^) < Pg, respectively. Power constraints at relays are given by 

EilxrtP] < Pri and E[|x^2p] < Pr2; 

• yri,yr2 e C, e C^^^ are the received signals at relays 1 and 2 and at the destination, 
respectively; 

• gi)g2 e C^^*^ are the channel gains from the source to relays 1 and 2, respectively, and 
hi, h2 e C^^^ are the channel gains from relays 1 and 2 to the destination, respectively; 

• riri, nr2 e C, rid e C^^^ are additive white Gaussian noise (AWGN) at relays 1 and 2 and 
at the destination, respectively. Noise at the relays and each antenna of the destination node 
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is circularly symmetric complex Gaussian, i.e., n^i, 71,-2 ~ CA/'(0,1) and n^^ ~ CA/'(0,I) 
and they are all independent of each other and from the signals. 
Throughout the paper, the following notation will be used, 
• The vector and matrix notations: 



yn 

yv2 



Xr2 



nr2 



G 



Si 

g2 



H 



hi hs 



. x^, a;p2' Z/ri' Z/r2' Yd denote length-n sequences of x„ Xri, Xr2, yn, yr2. Yd, respectively. 

• Ex[-] denotes expectation with respect to the distribution of x, IE^[-|y] does expectation with 
respect to the distribution of x conditioned on y, and the simpler notation E[-] without 
subscript will be used as long as it is apparent. 

• means the optimal value of a variable. 

An example for M = TV = 2 case where H and G are two-input two-output channels is 
shown in Fig. [U 

Definition 1: A (2"^, n) code for vector Gaussian parallel relay network consists of a message 
set W = {1,2,..., 2"^}, an encoding function at the source /, : w G {1, 2, 2"^} C^^^", 
relaying functions at two relays, fri^i : C*^^ C and fr2,i '■ C*^^ C, respectively, where 



■^Nxn 



w G 



1 < i < n is the time inde^u and a decoding function at the destination 
{1, 2, 2"^}. If the message w E W is sent, the conditional probability of error is defined 
as X{w) = PT{gd{y2) 7^ M'^ sent}. The average probability of error is defined as Pi"^ = 

w 

Definition 2: If there exists a sequence of {2"'^, n) codes with Pi"^ — > 0, the rate R is said 
to be achievable. 

Definition 3: The capacity C of a vector Gaussian parallel relay network is the supremum of 
the set of achievable rates. 



III. Capacity Upper Bound 

In this section, we derive the cut-set bound [21] applied to the vector Gaussian parallel relay 
network. From the four cuts shown in Fig. [2l we get the following cut-set bound: 

max min [/(x^; y^, Z/r2, Ydkrl, 2:^2), H^n, Xt2\ Yd), H^s, Xrl, Yd, yr2\Xr2), H^s, Xr2; Yd, yrl\Xrl)] 



'This means that the output of a relay at time i depends on all past received symbols. 
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Using the Markovity of the channel, i.e., ^ ixri,Xr2) ^ Yd and (a;^!, 2:^2, Yd) ^ 
{yri,yr2), it is easy to get the following loosened cut-set bound: 

max min [/(x^; yrl, yr2), H^rl, Xr2] Yd), I{y^s] yr2) + I{Xrl] yd\Xr2), I{y^s] Vrl) + I{Xr2] YdWl)] ■ 

For example, for the first term we get 

-^(Xs; yrl, yr2, Ydja^rl, 2:^2) = /(x^; 2/rl, |/r2|a;rl, 2:^2) + /(Xs; yd|a;rl, a;r2, |/rl, |/r2) 

< /(X^; yn, yr2) + I{^s\ Ydkrl, a:r2, yrl, yr2) 

= /(x^;yri,yr2) 

where the inequality and the last equality follows from the Markovity {xri,Xr2,yd) <-> x^ <-> 
(yrl, yr2)- For the third term we get 

/(X^, Xrl] Yd, yr2kr2) = /(x^, a^ri; ydkr2) + /(x^, Xrl] yr2\Xr2: Yd) 

= I{Xri; yd\Xr2) + H'^s', YdlXrl, Xr2) + H^s, Xrl] yr2\Xr2, Yd) 
= H^rl, yd\Xr2) + /(Xs, Xrl, yr2\Xr2: Yd) 

= /(Xri; y<i|Xr2) + /(X^; yr2kr2. Yd) + H^rl, yr2\^s: Xr2: Yd) 
= H^rl] Yd\Xr2) + /(X^; yr2kr2. Yd) 
< Ii^ri;Yd\Xr2) + Ii^s;yr2) 

where the third equality follows from the Markovity x^ {xri, Xr2) ^ Yd and the fifth equality 
and the inequality follow from the Markovity (xri, a:r2. Yd) ^ x^ <-> (yri, yr2). 

Note that this cut-set bound is optimized over the joint input distribution p(xs, Xri, Xr2)- Using 
this, we get the following capacity upper bound for the vector Gaussian parallel relay network. 

Theorem 1: The capacity of the vector Gaussian parallel relay network is upper bounded by 
the minimum of the three expressions given by 

C < R:Z:bc = , max log det (I + GQ^Qt) , (1) 

C< max min[logdet(l + HQ,Ht),log[(l + P,||g2||')(l + (l-|p|')Pri||hi||')]], (2) 

|p|e[o,i] 

C< max min[logdet(l + HQ,Ht),log[(l + P,||gi||2)(i + (i_|p|2)p^2||h2||2)]l. (3) 

|p|e[o,i] 
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where = E[xrxJ 



Proof: From the first cut, the following upper bound is derived: 

H^s] Vrl, yr2) = h{yrl, yr2) " h{yrl, 2/r2|xJ 

= h{yy) - K^r) 

< log(27re)2 det E[y^yJ] - log(27re)2 det E[n^nJ] 

= log det E[n,nt + Gx.xtG"^] 

= logdet(I + GQ,Gt) 

where the inequality follows from the fact that the circularly symmetric complex Gaussian 
maximizes the entropy [19]. From the second cut, the following upper bound is derived: 

I{Xrl,Xr2]yd) = h{yd) - hijd\Xrl, Xr2) 

= h{yd) - h{nd) 

< log(27re)^ det Eiy^y^] - log(27re)^ det E[n,n),] 

= logdetE[ndn^ + hihj|xri|^ + h2h2|a;r2|^ + hih2Xr.ix*2 + h2hJx*iXr2] 

= logdet(I + hihlP.i + hsh^P.a + hih^p/^^^ + hshjp*/^^) 

= logdet(I + HQ,Ht). 

where p = '^[^''^^^^ and note that we set Zp = Zhth2 in Q and (|3]). From the third cut, the 
following upper bounds are derived: 

/(Xs;?/r2) + IiXri;yd\Xr2) < log(l + g2Qsg2) + log(l + (1 - IpH^rl ||hlf ) 

< l0g(l + Ps ||g2||') + l0g(l + (1 - \p\')Prl llhif ) 

where the first inequality follows from the fact that the circularly symmetric complex Gaussian 
distribution maximized differential entropy and from the following property: 

E,^, [E^^,{\Xrlf \Xr2} ' K^AXrlM^] < (1 " \p\^)Prl, 

and for the second inequality = T--^g2g2 is used. Similarly, from the fourth cut: 

/(X,; yrl) + I{Xr2] yd\Xrl) < log(l + glQsgl) + log(l + (1 - \p\^)Pr2 \\h2f) 

< l0g(l + Ps + l0g(l + (1 - |pnP.2 ||h2f ). 
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By properly combining the above four bounds, we can see that the minimum of the three 
expressions given in the theorem statement results in a tighter upper bound. ■ 

IV. Decode-and-Forward (DF) 

In this section, we describe an achievable rate of the vector Gaussian parallel relay network 
with a DF strategy. With DF, the signal is delivered from the source to the destination in a two 
hop transmission. The source has three message sets: mi e {1, 2, 2"-^^} intended for relay 1, 
1712 £ {1) 2, 2"-^^} for relay 2, and nic E {1, 2, 2"'^'=} for both relays. Depending on the 
messages to transmit, the source node makes the signal as a function of mi, m2 and rric. 
Upon successful decoding of the signals, relays know their private messages and the common 
message. The relays re-encode the received information to make input signals Xri as a function 
of mi and rric, and function of m2 and rric as a block Markov manner. As the end-to-end 

channel is a cascade of MISO BC and SIMO MAC both with common information, we first 
investigate optimal signaling in the second hop. 

A. The Second Hop: SIMO MAC with Common Information 

The capacity region of the discrete memoryless MAC with common information is derived in 
[14], [16] and that of scalar Gaussian MAC with common information in [17]. The characteristics 
of the scalar Gaussian MAC were further investigated in [18]. The result can be extended to the 
Gaussian MAC with multiple antennas at the destination. 

Definition 4: A ((2"^i x 2"^^ 2"^^ x 2"^'=),n) code for the SIMO MAC with common 
information consists of three message sets mi = {1, 2, 2"^^}, m2 = {1, 2, 2"'^2|^ = 
{1, 2, 2"^=}, encoding functions at two relays, fri : {mi, rric) and fr2 '■ {Tn2,mc) 

C", respectively, and a decoding function at the destination : C^^" — > {mi,m2,rric). If 
the messages (mi,m2,mc) are sent, the conditional probability of error is A(mi,m2,mc) = 
Pic{ga{'y2) 7^ (?7ii, m2, mc)|(mi, m2, mc) sent}. The average probability of error is defined as 
^i"^ = 2»(fii+fi2+flc) E A(mi,m2,mc). 

(mi,m2,mc) 

Definition 5: If there exists a sequence of ((2"^i x 2"^^ 2'*^^ ^ 2"^-), n) codes with P^"-^ 0, 
the rate triplet (i?i, i?2, Rc) is said to be achievable. 

Definition 6: The capacity region of the SIMO MAC with common information is the closure 
of the set of all achievable rate triplets. 
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We will derive an achievable rate region assuming Gaussian input distributions. Each relay's 
input signal is a superposition of private and common signals: 



where v CAf (0, aPri), w CAf (O, pPr2), a^l-a,p^l-p,0<a<l, 0<P<1, 
and ui and U2 are partially correlated random variables in the sense that 



u 



Ui 
U2 



CM 0, Pc 



1 7 
7* 1 



The conditional probability density functions are given by 

p{Xrl\U]) ~ CN 



— — Ml, aPj-i 



p{Xr2\u2) ~ CA/" 



r2 



r2 



Note that the correlation coefficient between the relay input signals is given by p = ^p^ ~ 
7V^a^ and controllable by power allocation. The received signal at the destination is given by 



Yd = hiXrl + h2Xr2 + Hrf 

= hi (v H 



aPr 

Pc 



■Ui 



+ h2 (^w; + \[^u^ + m 
= hl^; + h2W + (^hi^^Mi + \i2^J^u^ + n^. 
= hiv + h.2W + 



(4) 



' 0Pr2 
Pc 



u + n<i. 



hi^^ h2^ 

The rate region of the SIMO Gaussian MAC in terms of mutual information expression can 
be written as follows 



T^MAC 



(i?l, i?2, Re) 



Rl < I{Xrl] yd\Xr2,Ui,U2), 
R2 < I{Xr2]yd\Xrl,Ui,U2), 
Rl + R2< I{Xrl, Xr2] YdWl, U2), 
Rl + R2 + Rc< I {Xrl,Xr2] Yd) , 

for some distribution p(mi, U2)'p{xr\\u\)-p{x r2\u2) where u\ and U2 are auxiliary random variables 
that represent common information. 

Theorem 2: The following rate region is achievable for the SIMO MAC with common infor- 
mation: 



a,l3,¥,[\x,\'^]<Pri,i=l,2 



(5) 
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where TZ (a, /5, 7) is the rate region for given a, (3 and 7, which can be expressed as 



7^(a,A7) 



(-Ri, i?2, Rc 



i?i <log(l + «P,i||hi|r), 

R2 < log(l+;5P,2||h2f), 

Ri + R2< log det (I + HQ^Ht) , 
Ri + R2 + Rc< log det (I + HQ.Ht) 



(6) 



where 



aPri 

^Pr2 



= Ex, [x,.xj,] 



7A/a/3PrlPr2 



Proof: It is straightforward to show the theorem result by evaluating the mutual information 
expressions assuming circularly symmetric complex Gaussian input distributions. ■ 

Next, we are interested in how to maximize the sum-rate and get the following result for the 
optimal correlation that maximizes log det (l + HQ^H^^). 

Lemma 1 ( Optimal correlation): For any A^, the sum rate of the SIMO MAC with common in- 



formation is maximized by Zp = Z7 = Zh{h2 and \p\ = \'J\^/aP 



mm 



VPriPr2det(HtH) ' 



TDmax 

^sum.MAC 



and the resulting maximum sum-rate is given by 

max log det(I + HQ^.H^') 

p 

log (1 + P,,i llhif + P,2 llhaf + P,iP,2 det(HtH) + 
log (l + Pri ||hif + P,2 ||h2f + 2v/i^:ii^|hlh2 

Proof: See Appendix. 



p\opt ^ I 
opt _ 



IP 



arccos ■ 



Remark 1: By defining the angle between channel vectors 
[0, 7r/2], and the geometric mean SNR^eo = V-PriPr2| |hi| 1 1 |h2| |, the optimal correlation can 
be also expressed as 



IP 



opt 



mm 



cos iph 



SNRgeo sin^ ^ph 



It is a monotonically decreasing function of and inversely proportional to SNR^eo. In Fig. [3l 
|p|opt drawn for different values of Lp^ and SNR^eo- 

For a fixed SNRgeo or for a fixed ph, there exists a threshold above which \p\°'P* < 1 and 
below which |p|°*'* = 1. The threshold is the solution of cosph = SNRgeo sin^ (^z^. 
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Remark 2: If hi and h2 are orthogonal, then |p|°P* = 0. If channel vectors are orthogonal, 
the differential entropy of the received signal vector is maximized when Xri and Xr2 are 
uncorrelated. The resulting sum-rate is given by 

max log det(I + HQ,Ht) = log(l + P,i | |hi| p) + log(l + P.sl Ihsl H- 
p 

If hi and h2 are parallel, then \p\"P^ = 1. If channel vectors are parallel, the differential entropy 
of the received signal vector is maximized when Xri and Xr2 are fully correlated. The resulting 
sum-rate is given by 



maxlogdet(I + HQ,Ht) = log(l + P,i||hi||2 + P.allhslT + 2/^^|hlh2|). 

p 

Remark 3: For a fixed H, if either P^i or Pr2 are sufficiently small so that |p|°P* = 1, the 
signaling is optimal when the relay signals are perfectly correlated. If Pri,Pr2 > and either 



Pri or Pr2 are sufficiently large so that \p\"' 



opt 



< 1, then \p 



\opt 



as either 



VPriPr2det(HtH) 

Pri or Pr2 ^ oo. If power is abundant, very small fraction of relay power needs to be allocated 



|7| 



1 and 



to common signals to satisfy optimality condition. 

Remark 4: For = 1, the sum rate is maximized by \p\ = 1, i.e., a = P 
Zp = Z{hlh2) where H = [hi /ig]- 

By combining the optimal correlation condition with the achievable region expression in 
we get the following result. 

Theorem 3 (Maximum sum-rate subregion): In the three-dimensional achievable region of a 
SIMO MAC given by the maximum sum-rate subregion is a surface whose boundary is 
characterized by 



where 



n{a) 



(Pi, P2, Rc 



U ^(") 



Ri < log(l + aP.i ||hif) 

R2 < log (1 + (1 - {\pr'/V^f)Pr2 \\h2f) for |p|°P* > 



(7) 



i?2 <log(l + P.2||h2f) for IpI 



opt 



Pi + P2 < logdet (I + HQ^Ht) 

Ri + R2 + Rc = logdet (I + HQ.H^) 



(8) 
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where 



(1 - a)Pri 
(1 



for > 0, 



Q 



Qr 



;i-«)Pri 

Pr2 

Prl 



for |p|°P* = 0, 



\p\°P^e-^^^l^WPrlPr2 



r2 



Proof: To satisfy the optimal correlation, < = |7|v^a^ < 1, |7|, y/a and y/j3 should be 
in the range [\p\°P\ 1]. In ®, by setting I7I = 1, and f3 = {\p\°Py ^/a)'^ for |p|°P* > or /3 = 
for |p|°P* = 0, and by taking union over |p|°P* < ^/a < 1, we characterize the boundary of the 
maximum sum-rate surface. ■ 
Example 1 (Close-to-parallel channel vectors): If |p|°^* = 1, it is required for relays to set 
a = /5 = I7I = 1. Substituting this condition into ©J we get the expression for the maximum 
sum-rate subregion which is a single point given by 

i?i = 0, i?2 = 0, 

|2 



-R2, Rc 



Rc = log(l + Prl ||hif + Pr2 \\h2f + 2 ^^.1^.2 1 hi ha | ) 
The example achievable rate region is drawn in Fig. |4] (a) and (b), and the maximum sum-rate 
point (0, 0, RTum,MAc) is on the R^ axis. 

Example 2 (Orthogonal channel vectors): If Ip]"^* = 0, at least one of a, (3 and |7| must be 
zero. We get the expression for the maximum sum-rate subregion given by 

i?i <log(l + P,i||hif) 

i?2<l0g(l + P.2l|h2f) 
Rl + R2 + Rc<Y^ log(l + Pri \\hi\ 



-R2, Rc 



> . 



i=l,2 



As it is shown in Fig. |4](d), the maximum sum-rate surface is the square connecting four points: 



/ TDiriax TDmax r\\ ( rymax n rymax TDmax\ ( n rymax jDmax 

l-Ki ,-K2 ,Uj, (^-K^ ^^^^sumMAC~^l )A^^^2 ^ ^. 



sum, MAC 



-i?^"^),and(0,0,i?; 



max \ 
sum, mac) 



where R^"-^ denotes the maximum rate that can be achieved by each message set. In the 
subregion, for any fixed Ri and R2, we can find Rc such that R^umMAc = Ri + R2 + Rc- 
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B. Impact of Common Information Signaling 

Let us discuss how much benefit we can get by having the common information for > 2 
case. If the source transmits only the private signal to relays, i.e. Rc = 0, the best strategy relays 
can do is to have diagonal covariance matrix with individual peak power QJ?*"^ = diag[Pri, Pr2]- 
Let Q"*"* denote optimal covariance matrix with sum rate maximizing magnitude and phase angle 
of p derived above. Then, we get the following result. 

Lemma 2 (Benefit of correlation): logdet (l + HQf^m^) < logdet (l + HQ'^^W) with equal- 
ity if and only if h|h2 = 0. The increase in SNR by having Q"*'* is given by 



Proof: : It is sufficient to show that the sum-rate is a quadratic and concave function of |p|, 
and is monotonically increasing for < \p\ < |p|°^*. The function has its minimum at \p\ = 
since \p\ is non-negative. When the channel vectors are orthogonal, the suboptimality vanishes 
since |p|°^* = 0. The SNR increase can be directly calculated using the result in Lemma [T] ■ 

When the channel column vectors hi and h2 are close to orthogonal, Qf"-^ is almost as 
good as Q°^*. However, when hi and h2 are close to parallel, the sum rate by having Q°p* at 
relays shows considerable increase from that by having Qjf*"^. The gain coming from optimal 
correlation becomes very large at low SNR. Fig. [5] shows the examples. 

With common information coming from the source, we can introduce correlation between 
relays, and they act as if they are in cooperation. The resulting SIMO MAC behaves like a 
point-to-point MIMO channel with per-antenna power constraint. 

Here, we can see that there is a minimum required Rc that needs to be transmitted from the 
source to relays for achieving maximum sum-rate in the second hop. 

Theorem 4 (Threshold of Rc): In the SIMO MAC with common information, the threshold 
of Rc above which a maximum sum-rate point can exist is characterized by 




Rf = log 



det (I + HQ°P*Ht) 
det (I + HQ^Ht) 



where = diag[{l - k\p\"P^)Pri, (1 - k-^\p\"P^)Pr2] and k 



Pr2Hh2|P+PrlPr2 dct(HtH) 

Pri||hi||^+PrtPr2 det(HtH)' 
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Proof: In the maximum sum-rate subregion in ([8]), after evaluating det(-) operation, we 
get the expression for Ri + R2 given by 

Ri + R2< 



D IIU l|2 , /i „, , |.|2 |P 



2 



log + aP,i ||hif + (^1 - ^ j 11^211' + (^1 - a + IpI' - ^ j P.iP.2det(HtH) 
It is straightforward to check that the maximum of Ri + R2 is given by 

max(Pi + R2) = logdet(I + HQ^H^) 

a 

with given in the theorem statement. Finally, R^^ = R^umMAC ~ niax(i?i + R2) results in 
the minimum possible value of Rc while staying in the maximum sum-rate subregion. ■ 

C. SISO MAC versus SIMO MAC 

Optimal signaling at DF relays depends on the channel condition. For a SISO MAC with a 
single antenna at the destination (A^ = 1), the sum-rate is maximized by a = /5 = I7I = 1 so 
that Ri = R2 = regardless of the channel and power constraints. This is the case when all 
the power is allocated to the common signal at both relays and they add up coherently at the 
destination. It is desired for the source to transmit as much common information to relays as 
possible, and this strategy maximizes the source-to-destination sum-rate. Even when N > 2, 
if hi and h2 are close to parallel in the sense that det(Hl^H) is small and |p|°P* = 1, fully 
correlated relay signals are still optimal. 

In contrast, with multiple antennas at the destination (N > 2) and |p|°P* < 1, sum-rate 
maximizing a and P depend on both the channel matrix H and relay power constraints. Any 
combination of power allocation factors at relays such that \^\^/a^ = , ^'^^^}. < 1 



VPriPr2det{HtH) 

together with optimal rotation angle Z7 = Zhjh2 can maximize the sum rate of a SIMO 
MAC. In this case, the source needs to transmit just the right amount of common information 
so that signals at two relays are optimally correlated and the source-to-destination sum-rate is 
maximized. 

D. The First Hop: MISO BC with Common Information 

In [1], the first hop is a degraded scalar BC where one relay with higher SNR can decode 
both its intend signal and the signal for the other relay by doing superposition coding and 
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successive interference cancellation. In this case, correlation between relay input signals are 
naturally introduced. In contrast, our first hop is a non-degraded vector broadcast channel that 
makes it possible to send private signals, each decodable by one of the relays, as well as a 
common signal decodable by both relays. For this class of channels, the three dimensional 
capacity region is not known, but a good achievable region combining dirty paper coding (DPC) 
[13] and superposition was studied in [10]-[12] which we also use here. 

In this scheme, the transmitting signal is a superposition of three independent signals xi, 
X2 and Xc, i.e., x^ = xi + X2 + Xc, where xi, X2, Xc G C^^^ denote the signals intended for relay 
1, for relay 2 and for both relays, i.e., the common message, respectively. We assume Gaussian 
signaling for all signals. Input covariance matrix is Qs = Qi + Q2 + Qc, where Qj = E[xjxj], 

je{l,2,c}. 

Common information is decoded at both relays before decoding private messages. Private 
messages are encoded using dirty paper coding, i.e., the private message for relay 1 is first 
encoded as xi, and the private message for relay 2 is then encoded as X2 using xi as side 
information so that X2 can be decoded at relay 2 without interference from xi. The encoding 
order can be reversed. With this scheme, an achievable rate region is given by 



Co 



(9) 



U ^(^'Q 

where IZ (tt, Q^) is the achievable region for a given encoding order tt G {tii2, '^21} and input 
covariance matrix Qs, where Co(-) is the convex hull operator. If X2 is encoded first, for example, 
then we have 

Ri<\og (l + giQigl) 
R2 < log (1 + ^^"^^^^ 



'^(7ri2,Qs) 



i?2, Rc 



l+g2Qlg^ 



> . 



(10) 



i?c < min log f 1 + — t 

ie{i,2} i+g,(Qi+Q2)gI, 

Fig.[6l (a) depicts an example of an achievable region where two row vectors of G are parallel 
and linearly dependent so that G is ill-conditioned and rank-deficient. Note that in the figures, 
LDn = arccos n-^f^- One can see that the maximum sum-rate surface is a plane connecting 

llgillllgall ^ ° 

three points: (i?™^^^, 0, 0), (0, i^^^^^, 0), and (0,0, i?™^^) where denotes the maximum 

rate achieved by allocating all power to Xj so that Qj = Q^: 

R^S^c = max log (l + g,Q,gl) = log (l + \\g,f) 
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= maxminlog(l + g^Q^gl) = minlog (l + ||gif ) 

where i G {1,2}. In this specific example, the channel is symmetric in the sense that 1 1 gill — 
||g2||. In fact, this is the only case where having common information does not incur sum-rate 
penalty. 

As the opposite extreme. Fig. [6l (b) depicts an example of an achievable region where two 
row vectors of G are orthogonal and linearly independent so that G is well-conditioned and 
full-rank. In the symmetric example, the point that achieves the maximum sum-rate 

R7Z,BC = log(l + y llgill) + log(l + y ||g2||) 

is on the line Ri = R2 and Rc = 0. The point that has the minimum sum-rate on the boundary 
is on the Rc axis, i.e., Ri = R2 = and 

R'^^^l. = niaxminlog(l + g.Q.gj) = log(l + :^||gi||) = log(l + ^Wg^W) 

where we can see the sum-rate penalty due to beamforming inefficiency. 

Note that the maximum sum-rate points of a MISO BC are always on the Ri — R2 plane. 
In fact, they correspond to the dominant face of the two user BC achievable region by DPC 
without common information. 

E. Achievable Rate by DF 

For the GPRN drawn in Fig. [H a triplet {Ri, R2, Rc) is said to be achievable by DF if it 
belongs to the intersection of the rate regions of the first hop MISO BC and the second hop 
SIMO MAC. In this context, the maximum rate by DF can be defined by 

Ri;''^ = max R1 + R2 + Rc (11) 

{i^l,R2,-f^c)e7^I,F 

where TZdf = TIbc {Ps)^'T^mac (Pri, Pri)- Fig. Ill shows examples of the rate regions of MISO 
BC and SIMO MAC, the intersection of which is the achievable rate region by DF. 

If the source-to-relay link SNR is high enough, the second hop becomes the bottleneck and 
determines the source-to-destination sum-rate. 

Theorem 5 (Optimality condition of DF): If there is a rate triple {Ri, R2, Rc) G 'R-sub (IpT^*) 
which is included in the MISO BC region TZbc (Ps), then -R^f? = R^uZ,mac meets the upper 
bound and determines the capacity of the vector Gaussian parallel relay network. 
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Proof: Let us first consider |p|°P* = 1 case where tliere is a single maximum sum-rate 
point in the SIMO MAC region. At |p| = 1, the term logdet (l + HQ^H^) in © and © is 
maximized and is smaller than ([U) since the following relationships are hold: 



JDmax ^ urnax ^ rtmax /„• ^ J 1 OW ^ umax ^ jjupper 

^sum,MAC — ^c,BC — ^i,BC\'' ^ l^^^j) — ^sum,BC — ^BC 

We can achieve the tightest upper bound R^um,MAc allocating all relay power to the common 
signal: a = (3 = \'^\ = 1. 

Now we consider < 1 case where there exist more than one maximum sum-rate point 
in the SIMO MAC region. It is tedious but easy to verify that, at \p\ = \p\ 



I opt 



-pmax ^ Timax ^ rfupper 

^sum,MAC — ^sum,BC — ^BC 

21ogdet (I + HQ,Ht) < ^ log(l + P, ||g,f ) + ^ log (l + (1 - \p\^)Pr^ ||h,f ) . 

i=l,2 i=l,2 

We can achieve the tightest upper bound -R^^ mac optimal power allocation at relays such 
that = ItIVo/?- ■ 

With DF, the first and second hops are completely separated in the sense that after finishing 
the first stage of transmission, relays start a new stage of transmission by encoding the received 
information again. Here, the right approach is first to figure out what is optimal in the second 
hop, and then to check if the optimal operating point, i.e., one of the maximum sum-rate points 
of the SIMO MAC is supportable by the first hop. If the optimal point is achievable, the network 
nodes would start communication by setting parameters to satisfy optimality conditions. If none 
of the maximum sum-rate points of the SIMO MAC is achievable, then the nodes would try to 
find the operating point as close to the optimal as possible. 

What if the relay-to-destination link SNRs are high enough so that the first hop is the 
bottleneck? If one of the maximum sum-rate points of the MISO BC on the -Ri — R2 plane 
is included in TZmac, then R'^^'jf = R^umBC- this case, the broadcast cut-set upper bound in 
© is tighter than the others. It turns out that the upper bound and the achievable rate meet in 
some special cases where the first hop row vectors are orthogonal as will be seen in numerical 
results in Section VII. However, they do not meet in general, which implies suboptimality of DF 
in the case. If the first hop is the bottleneck, full decoding at relays gives too much restriction, 
and AF and CF schemes can do better. 
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F. Symmetric Channels 

In this subsection, we narrow down our attention to the symmetric channels: ||gi|| = ||g2||, 
II hi II = ||h2||, Pri = Pr2, and -Ri = R2. We consider four examples illustrated in Fig. [H where 

Rp = -Ri + R2- 

In Fig. [H (a), the straight line AB and the curved line BC constitute the surface of the MAC 
achievable rate region. The curved line EG is the surface of the BC achievable rate region. Here, 
we have the source power constraint Pg so large that the upper bound ([T]) and the second terms 
of min in (O and ([3]) are loose. In this case, logdet (l + HQ^H^) is the active upper bound, 
and the sum-rate constraint Ri + R2 + Rc is the straight line that goes through the points A, 
B, and D. The straight line AB is the maximum sum-rate subregion of the MAC, and F is the 
crossing point of the BC and MAC surfaces. All the points on the line FB achieve the capacity 
of the vector Gaussian parallel relay network as they are in the BC and MAC achievable rate 
regions and meet the sum-rate upper bound. 

Other things being equal, the BC rate region with a smaller power constraint is drawn in Fig.O 
(b). In this example, the crossing point F coincides with the point B. Thus, there exists a single 
capacity achieving point at B = F. In Fig. [8l (c), the BC rate region gets even smaller, and the 
DF maximum sum-rate point F does not meet the sum-rate upper bound. Thus, in this case, DF 
does not achieve the capacity of the vector Gaussian parallel relay network. Finally, Fig. [8l (d) 
illustrates the case where the source power constraint Pg is so small that log det (l + HQ^.H''^) 
in the upper bound expression is not active anymore. 

V. Amplify-and-Forward (AF) 

We have seen that if the relay-to-destination link SNR is high enough, the first hop is the 
bottleneck and DF does not satisfy the optimality condition that requires at least one maximum 
sum-rate point of SIMO MAC should be inside MISO BC achievable region. Instead of requiring 
signals with low SNR to be decoded at relays, it would be better for relays to just forward their 
received signals to the destination so that the benefit of high SNR in the second hop is maximally 
utilized. 
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A. Achievable Rate of AF 

The received signal at relays can be expressed in vector notation by 

With AF, the relays just amplify their received signals before forwarding them to the destination, 
and the transmit signal vector of the relays is given by 

where A = diag[ae^'^, b]. The amplification factors should be in the range 

< a < a^'""*^ = . / — r, < 6 < 6^'""^ = , / — r 

because of the power constraints at the relays. The received signal at the destination is given by 

yd = Hx^ + rid = HAy^ + 
= HAGxs + HAiir + Ud 

— HAGXs + He 

= (ae-^'^higi + 6h2g2)xs + {ae^'^ririhi + bnr2h2 + n^) 
where ng denotes the total effective noise. Since the noises added at relay receivers are also 
amplified and forwarded through the channel, the noise vector ne is spatially non-white in 
general. Noise covariance matrix is symmetric and can be decomposed as 

K = Efneii^] = I + HAA^H^ = U^AU 

where A is a diagonal matrix with eigenvalues of K as its diagonal elements, and U is a unitary 
matrix. Then, the channel can be transformed into an equivalent white noise channel given by 

A-^/^Uy^ = A-^/^UHAGx, + A'^/^Une = Fx, + 

where F and denote the effective source-to-destination channel matrix and the white noise 
vector, respectively. For a fixed A, this is a point-to-point MIMO channel whose maximum rank 
is 2 limited by the number of relays. If all the input signal is Gaussian, we get the expression 
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for an achievable rate by AF given by 

Raf < /(xs; Yd) 

det (I + HAA'^Ht + HAGQ^QtAtHt) 
~ det (I + HAA"^Ht) (12) 

= log det (I + A-^/^UHAGQ.G^AtHtU^A-^/^) 

= log det (l + FQ,Ft) . 
In order to get the maximum achievable rate, the source signal covariance matrix and the 
relay amplification matrix A need to be jointly optimized. 

Theorem 6 (Asymptotic Optimality of AF): If H is full rank, AF is asymptotically optimal in 
the high relay power limit in the sense that 

lim (max log det (l + GQ„G"'') — mas^RAp) = 0. 



Proof: By rearranging (fT2l) . we get 

Raf = log det (l + HAGQ.G^AtHt (l + HAAtRt)"'' 
= log det (l + GQ.G^AtHt (l + HAA^H^)"^ Ha) 

= log det (l + GQ,G^ (l - (I + A^H^HA)"^)) 
where we use matrix inversion lemma. We first set a and b to peak values under relay power 
constraints, assume cj) is optimally chosen, and let R^p^ denote the corresponding rate. By 
showing that if det(HtH) > 0, (l + AtRtHA)" ^ as a ^ oo and b ^ oo where 

l + fe^llhaf -afoe-^'Viha 
-abe^'^hlhi l + a^llhil 

(l + AtHtHA)-' 
we get the following result 



1 + a2 llhif + 62 llhsll^ + det(HtH) 



lim flog det (I + GQ.GH - R^^f) = 
Then, the theorem statement naturally follows since by definition, for a fixed Q^, 

^pea/c ^ max Raf- 
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B. Iterative Optimization Algorithm for AF 

We can maximize Raf by an iterative algorithm as follows. For optimizing Q^, we apply 
singular value decomposition (SVD) to F and waterfiUing over two parallel scalar channels with 
non-zero singular values [19]. First, we define the covariance matrix of Gx^ and the rate function 
of (a, h) given by 

= E[Gx,xtGt] = GQsGt = 

R{a, h) = 



(l2l (l22 



I ^ det(HtH)(tr(Q^) + det(Q^)) + \\hifqii + \\h2fq22 + 2ae-^%h\h2q2 i 

Next, we do the following steps: 
Step 0) Set Q, = diag[Ps/2, Ps/2]. 

Step 1) Calculate = GQ.G^. 

Set a^-^ = If^^' = and = Z{h\h2q2i). 

Step 2) Calculate maxi?(a, Jf^'''') subject to < a < a^^"'' by solving ^i?(a, Jf^'''') = 0. 

Calculate max i?(a^"^''^ 6) subject to < 6 < by solving ^i?(aP""^ 6) = 0. 
Between (a"^*, 6^'^'^'=) and (a^^"'^, 6°^*), choose the one that results in a higher rate. 

Step 3) Set A = diag[ae^'l' , b] using the values obtained above. 

Calculate K and do eigenvalue decomposition to get U and A such that 

K = I + HAA^H^ = AU. 

Calculate F = A-V2UHAG. 

Step 4) Optimize Q, via singular value decomposition of F and waterfiUing [19]. 
Update Qs and calculate Raf = logdet (l + FQ^F^). 
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Step 5) Terminate if Raf already converged to a certain value. 
Otherwise, go to Step 1. 

Before closing the section, it is worth noting that full power transmission sometimes hurts. This 
is the case when one of the relays has received a signal with very low SNR so that transmission 
at full power degrades the received SNR at the destination. Fig. |9] shows examples. For each of 
the two different values of ||g2|| shown in the figure, we run the algorithm steps from to 4 
just once, and draw the resulting R{aF^°-^,h) versus h curves. For the curve in Fiq. |9l (a), the 
maximum of the curve indicated by a circle happens at a point of h above 6^*^°^ indicated by 
vertical line. It means that the received SNR at the second relay is still high, and full power 
transmission helps. However, for the curve in Fiq. |9l (b), as the maximum happens at a point 
less than If^'^^^ the received SNR at the second relay is too low for transmission at full power 
to be optimal. 

VL COMPRESS-AND-FORWARD (CF) 

For CF, relays compress or quantize their received signals, re-encode, and forward them to the 
destination. At the destination, the decoder tries to decode the received signal to recover relay 
input signals, and finally decompress the relay signals to recover the information transmitted 
from the source. CF achievable rates were first derived by applying Wyner-Ziv source coding 
[15] to a classical one relay model in [3], their extension to multiple relay models in [4]. The 
derivation for a special case of the Gaussian parallel relay network with N = M = 1 can be 
found in [1] and [2]. The extension to our network model in terms of mutual information is 
straightforward as follows 

RcF < H^s;yri,yr2) 

I{yr2]yr2\yrl) < I r2\ J d\x rl) (13) 
liVrl, yr2] yrl, l/r2) < H^rl, '^r2] Yd)- 

By introducing quantization noise, we have a compressed version of relay signals given by 

yr\ = yrl + Vaflrl 

(14) 

yr2 = yr2 + Vbhr2 
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where a, 6 > 0. Assuming the quantization noise and all input signals are Gaussian distributed, 
we can evaluate the mutual information expressions to have the following result. 

Theorem 7: With CF, the following rate is achievable in the vector Gaussian parallel relay 
network. 

dot (1 + A + GQ,Gt) 

RcF = max log -— 

Q„A ^ (i + a)(l + 6) 

det (I + A + GQ.Gt) ^ „ .X 

subject to log f- ; , < log(l + Pri ||hi|| ), 

a(l + 6 + g2Qsg^) 

dct (I + A + GQ,G^) . 

6(1 + a + giQ,g{) '<^^) 

det (I + A + GQ.Gt) , , , 

log r -^^^—^ < log det (l + HQ.Hn , 

ab ^ ' 

tr{Qs) <Ps, 
a,b>0 

where = Efx^xJ], = Efx^xJ] = diag[Pri, Pr2\, and A = diag[a, b]. 

Proof: It is straightforward to show the theorem result by evaluating the mutual information 
expressions with the assumption that the input distributions are circularly symmetric complex 
Gaussian. ■ 

Similar to the AF scheme, the CF achievable rate becomes close to the upper bound as the 
relay power goes to infinity. We get the following result for the CF achievable rate. 

Theorem 8 (Asymptotic Optimality of CF): In the vector Gaussian parallel relay network, re- 
gardless of the rank of H, CF is asymptotically optimal in the high relay power limit in the 
sense that 

lim (max log det (l + GQ.G'^) - Rcf) = 0. 

Proof: As P^i and Pr2 go to infinity, the optimization of Rcf becomes unconstrained. The 
objective is maximum when a — b — 0. Thus, 

maxlogdet (l + GQ,G^(I + A)"^) ^ maxlogdet (l + GQ,G^) . (16) 
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VII. Numerical Results 

In this section, we consider a few numerical examples to compare achievable rates by different 
schemes and the upper bound derived throughout the paper. Let us pick three symmetric matrices 
for G (or H): 



10 




0.9285 0.3714 


, and 


0.70710.7071 


01 




0.3714 0.9285 




0.70710.7071 



The angles between channel row (or column) vectors are 90°, 46.3972°, and 0°, respectively. 
Fig. [To] shows the results of six different combinations of the first and second hop channel 
matrices where the achievable rates by DF, AF and CF, and the upper bound are plotted. 

As we have investigated in Section IV, below a certain level of the relay-to-destination link 
SNR, DF achievable rate meets the upper bound. The threshold point at which DF starts achieving 
the capacity can be calculated from the DF optimality condition. In Fig. [TOl (a) and (b), we can 
see that when the first hop channel vectors are orthogonal, DF always performs better than AF 
and CF, and achieves the capacity in the high relay power regime. In contrast, when the channel 
vectors are not orthogonal as in Fig. [TOl (c), (d), (e) and (f), DF achievable rates are bounded 
away from the upper bound in the high relay power regime. 

When the second hop channel matrix is full rank as in Fig. \W\ (a), (c) and (e), AF is shown 
to asymptotically achieve the capacity in the high relay power limit. In Fig. \T0\ (b) and (d), AF 
achievable rate stays away from the capacity even in the high relay power limit since the second 
hop channel is rank-deficient. In Fig. [TOl (f), again, AF becomes asymptotically optimal even 
though the second hop channel vectors are not full rank. In the case, as the first hop channel is 
already rank-deficient, there is no additional penalty by the rank-deficient second hop. CF seems 
to be advantageous over AF in the sense that it asymptotically achieve the capacity in the high 
relay power limit regardless of the rank of the second hop channel. 

VIII. Conclusion 

Throughout the paper, we have shown how much rate is achievable by DF, AF or CF, and 
when the achievable rates meet the upper bound. The relative advantage of each scheme varies 
depending not only on which hop is the bottleneck but also on the ranks of the first and second 
hop channel matrices. The effect of the channel rank is newly explained in our work. 
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For the DF relaying, we used a combination of a MISO broadcast scheme and a SIMO multiple 
access scheme, with which a few interesting characteristics of the SIMO MAC are investigated. 
It is shown that DF achieves the capacity in the low relay power regime. 

Earlier results for AF and CF were extended to explain our vector Gaussian network and to 
compare their achievable rates to that of DF. AF was shown to achieve close-to-capacity rate in 
the high relay power regime when the second hop channel matrix is full rank while CF similarly 
achieves the asymptotic capacity regardless of the channel rank. 

Appendix I 
Proof of Lemma 1 

First, we shall find the optimal angle of p. By differentiating det (I + HQj.H^) = det (I + Q^H^H) 
with respect to 9 and setting it to zero, we get 

Since the left hand side is the conjugate of the right hand side, they both should be real, which 
means the optimal 6 needs to satisfy 

rf* = -Z(h|hi) = Z(hIh2). 

Using this optial angle, we can solve the following convex optimization problem to find the 
optimal \p\: 

maxdet(I+HQ^Ht) 

subject to < IpI < 1 
where its Lagrangian function is given by 

L{\p\ , A) = - det(I+HQ,Ht) + Ai(|p| - 1) + A2(- 

The Karush-Kuhn-Tucker (KKT) condition is given by 

VL(|p| , A) = 2 IpI VP,iP,2det(HtH) - 2|hlh2| + Ai - A2 = 0. 

Solving this for \p\ gives 

^ |hlh2| + (A2-Ai)/2 
~ V'^^det(HtH) ■ 
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From complementary slackness, it must be satisfied that Ai(|p| — 1) = and A2|p| = 0. Thus, if 
< IpI < 1, then the optimal solution would be Ai = 0, A2 = 0, and 

Ihlh^l 
^Pr\Pr2 det(HtH)' 
Likewise, we also have the following two sets of solutions, 

|p| = 0, Ai = 0, A2 = 2|hlh2| 

IpI = 1, Ai = 2^PriPr2 det(HtH) - 2|hlh2|, A2 = 0. 

In other words, the function logdet(I + HQ^H^) is a quadratic and concave function of |p| 
with its maximum at Ipl' = ,„ > without constraints. If \n\ < 1, the constraint is 

" ' V-Pri-Pr2 dct(HTH) — iri — ' 

inactive so \p\' maximizes the objective function. If \p\' > 1, it violates the constraint, and the 
objective function has its maximum at the boundary of the feasible set \p\ — 1. 
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Fig. 1. System model 
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Fig. 2. Cut-set upper bounds 



September 10, 2009 



DRAFT 



28 




-10 -5 5 10 15 20 25 30 



SNR3(dB) 
(b) Optimal correlation versus SNRg 
Fig. 3. Optimal correlation as a function of tph and SNRg 
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(c) (/Ph = 35°, = 0.5. (d) = 90°, \pr' = 0. 

Fig. 4. SIMO MAC achievable regions with P^i = _Pr2 = 5 and ||hi|| = HhaH = 1 
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(c) = 35°, IpI"*" = 0.5. (d) ipu = 90°, \p\°^^ = 0. 



Fig. 5. Sum-rate versus \p\ with Pri = Pr2 = 5 and !|hi|| = ||h2|| = 1 
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(a) Three-dimensional region 

5r 




(b) Cross section along the surface Ri — R2 
Fig. 7. DF achievable region: = 10, Pri = Pr2 = 4.17, ^ (fh ^ 46.3942°, |pj°'" = 0.31 and Rf = 0.79. 
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(c) No DF optimal point. 
Fig. 8. Symmetric channels. 



(b) Single DF optimal point. 
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Fig. 9. Ria^""^, b) versus h with Ps = 10, Pri = Pr2 = 5, ||hi|| = HhaH = 1 and tpg ^ tpn = 46.40' 
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(c) ipg = 46.3972° and iph = 90° 



(d) ifg = 46.3972° and iph = 0° 
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(f) (fg = 0° and (fh = 0°. 



Fig. 10. Upper bound and achievable rates versus relay power. Note that Ps — 10 (dB) and ||gi|| = ||g2|| = ||hi|| — \\h2\\ = 1. 
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